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ABSTRACT 

/The purpose of the analysis was to provide a profile 
of instructional activities related to conteat and . referenced to 
specified instructional outcome areas. Emphasis was placed on 
determination of four -major factors: (1) major outcomes in the 
program ^nd their relative emphasis in both regular, and suppl^mentary 
instructional materials^ (2)' the 'distribution of content" within and 
across instructional units (chapters) , (3) points in the 
instructional sequence where mastery of outcomes is assessed/ and 
the amount of independent practice in regular and suppl,ementary 
instructional materials related directly to each major 'outcome 
developed in the program. The analysis was organized around 21 
content strands^ and is presented in a series- of tabled which 
indicate page locations of various topics. The complet/ed analysis 
forms the basis for preliminary specification of an application of 
Learning Mastery System procedures to the system. (Author/SD) 
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. ABSTRACT 
A, content analysis was completed of the Addison-Wesley mathematics 
series for elementary grades. The purpose of the analysis* was to pro- 
vide a profile of instructional activities related to content and refer- 
enced tfo specijfied instructional outcome areas. Emphasis was placed on 
determination of: ' 

1. major outcomes in the program and their relative emphasis In 
both regular ^d supplementary instructional materials. 

2. the distribution of content within and across instructional 
units '(chapters) . 

' y 3. points in the instructional sequence where mastBry of -outcomes 
is assessed. 

* *' 

4. the amount of independent practice in regular and supplementary 
^ instructional materials related directly to each major outcome 

developed in the program. 

V) 

' The completed analysis forms the basis for preliminary specifica- 

tion of an application of Learning Mastery System procedures to the 
^ series. 
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OOirreNT ANALYSIS OF ADDI SON-WESLEY MATHEMATICS PROGRAM FOR ELEMENTARY 
GRADES K-6 _ 

Aaron Buchanan^ Elijah Babikian, Jim Winchester and Sylvia Auton 

This document describes a content analysis of the Addi son-Wesley 
mathematics series for ^elermentary grades. The docqmentr^s divided into 
three sections as follows: 

Description of the Analysis . Procedures used by sttiff members of 
the Southwest Regional Laboratory for Educational Research and Develops 
ment (SWRL) in performing the analysis are described. These procedures 
were used to generate^ descriptors of instructional outcomes from index 
entries in the Addison-Wesley teacher's editions and to determine the 
location of instructional and evaluation activities relevant to these 
outcomes in various Addison-Wesley components. o y 

Interpretation of the Analysis . Procedures are recommended for 
identifying relationships in the analysis table between content organic 
zation, evaluation of outcomes, and provisions for individual^ practice, 
and for comparing these relationships with those desired in^applica- 
tion of a Learning Mastery System. 

Preliminary Specifications of a Learning Mastery System Application . 
Broad preliminary specificationa for the architecture of an application 
of a Learning Mastery System to the Addison-Wesley series are presented. 
These specifications include: (1) a dispr^te number of broad instruc- 
tional outcomes that can serve a,8 a unifying structure for assessing 
pupil progress through various levels of the program, (2) suggested 
evaluation components, and (3) ihaterials suitable for individual prac- 



tlce on outcomes assessed in LMS throughout, the program* 
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DESCRIPTION OF THE ANALYSIS 
CONTENT STRANDS 

The analysis is organized around twenty-one vertical strands of 
content identified by Addison-Wesley as basic units of a program struc 

ture. These strands are listed below in the order of their appearance 

/ 

in the program scope and sequence cfiart in each teacher's edition. 

** * 

« 

Set Concepts , 
/ Place Value 

Operations 

Sequences * v 

> Inequalities 
Notation * 
Number Facts 
Equations and Solutions 
Number Line 
Basic Principles 
Processes (Algorithms) 
Rational Ninnbers 
Ratio and Proportion ^ 
Problem Solving 
Logic 

.Number Theory 
^ Estimation 
Measurement 
Geometry 

Graphs and Scale Drawings 
^ Special Topics 

OUTCOME DESCRIPTORS 

For each strand and substrand ^ a set of outcome descriptors has 
been prepared by SWRL stafjE to describe the content at each level of 
the program* These descriptors are statements of expected outcomes of 




instruction. An example of despriptors for the "Place Value" strand 
Grade 5 is shown beltfw. 

1. Read arid write ntunerals^ 

Itiousands 
Millions 

Billions to Quintillions 

2. Identify place values of digits in numerals 

Whole numbers * ' < 
Decimal numbers^ 

3. Recognize numerals in different bases 

• * 

Base-lO numerals 
Base-4 numerals 

4. Represent numerals in expanded form 

5. Write numerals using different notations 



Exponential notation 
Decimal notation 

&•» Represent numbers by concrete models^ 

Abacus 

Base ten machine 

Outcome descrip^tors were derived using the following procedures: 

1. All entries in the index of the teacher's edition were par- 
titioned according to content strands listed in the scope and sequence 
chart. Since scope and sequence entries overlapped among 

some strands, elementary priorities in classification were followed 
which eliminated most of the multiple listing of index entries, 

2. Within each strand, index entries were translated into a small 
set of statements of intended mathematicaJ^ehaviors (outcome descrip- 
tors), •*ln some instances, the descriptors are comprehensive, and no 
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subordinate outcotoes are included; in other instances, subordinate 
outcomes are itlcluded because major portions of the instructional 
materials were demoted to their review. 

T^LE ENTRIES 

Instructional activities -(designated lessons) from the core com- 
ponents of the ^ddison-Wesley program were classified according to 
the prespecified outcome descriptors. Hie core components used were the 
student text (teacher ' s 'edition) , the student workbook, and a separate 
battery of chapter tests. Since the purpose of the analysis was to 
obtain a profile of instructional activities, an exhaustive listing of 
all activities included in all components was not necessary. Diagnostic 
tests were not included because they were chapter pretests which 
paralleled the structure and function of chapter tests. A descrip- 
tion of major supplementary program components is in Appendix Am 

Entries In the table refer to page numbers In the student text 
and workbook, and the chapter tests where instructional activities 
pertinent to the outcome descriptor are located. For each entry,/ the 
number of items or problems directly related to the outcome descriptor 
was determined. It was reasoned that item frequencies directly related 
to an outcome descriptor are better indicators of the amount of inde- 
pendent practice provided in. a chapter for each outcome than are page 
entries. ^ in determining item frequencies the number' ten was chosen 
as a cutoff point since most Instructional activities related princi- 
pally to major outcomes contained at least ten items of practice. An 
entry of (10) following a set of page entries or a chapter test indi- 
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cates that ten or more items providing direct practice on the outcome 
* were found. 

During the course of the analysis, it became necessary to develop 
conventions for determining item frequencies. Items were counted 
according to the number of separate responses requiring direct outcome- 
related performances. In some instances, such as the reproduction of 
counting sequences, individual responses were not independent of each 
other. In this case, each separate sequence was counted as a response. 
In many instances, mastery of a particular outcome, such as recognition of 
commutativity of addition, would be helpful in making a response, but 
unnecessary. Where responses could be made as a result of acquisition 
of some other outcome, especially an outcome that is learned rather 
early in the instructional sequence (such as recognition pf number 
facts), no items were recorded with the descriptor. Conventions were 
also developed for classifying problems in activities involving either 
number line or semi-concrete pictorial models to solve equations, s 
While use of the model might be helpful in making a required response, 
it was seldom required that the model be interpreted; a recall of basic 
number facts or the application of some computation algorithm was • 
usually sufficient. In instances such as these, an item was recorded 
for purposes of the analysis with a descriptor involving '^models** if 
there were separate representations of the model for each equation. 
Actual entries for a particular descriptor are-coded as follows; 
1. Pages from the student text (or student pages from the 
teacher's edition) appear in regular typeface with the number of items, 
to 10, following in parentheses. 



7 



' 2. Pages from the student workbook and the number of related 
items, to 10, are underlined. 

3. Chapter test entries are preceded by CT with the number of 
items related to the descriptor following. 

INTERPRETATION OF THE ANALYSIS 

CONTENT STRANDS ^ 

The distribution of content in the program can be inferred from 

the analysis in the following ways: 

1. Examination of Instruction and Evaluation Entries for a / 

♦ 

Particular Outcome Across Chapters and Levels , It is possible to draw 
'some conclusions concerning the independence of one outcome from another. 
If there are several instructional entries, but few review or evaluation 
entries, it is possible to infer that this outcome cannot be easily 
separated from other outcomes during instruction. Hxis inference is re- 
lated to methods used in development of the analysis. The major source 
of instruction entries (textbook) was the index of tea^iher' s editions 
at each level. Since index entries are likely to be classified with 
as many coritent domains as are possibly relevant, there was some mul- 
tiple classification among instructional entries. Review and evaluation 

entries, on the other hand, were made from a page-by-page analysis of 

/• * 
the components. In this case, multiple classification was avoided 

«• • 

wherever possible, and activities were referenced to the outcome with 
the most appropriate descriptor. Most of the multiple classification, 
which is n6t extensive in' Add i son-Wesley, occurs in "Operations", 



7 

"Number Facts", "Processes" and "Rational Numbers", For example, 
operation^ on rational ntnnbers were often classified under both 
"Rational Nttmbers" and "Processes". 

2, Examination of Entries in the Chapter Columns . For purposes 
of a Learning Mastery System it is desirable that content included in 
each chapter be reasonably homogeneous. Unit division should be de- 
termined primarily by outcomes to be acquired and their presentation 
sequence. Hie instructional entries in each chapter should be spread 
over ho more than 7 or 8 outcomes if evaluation of mastery is to 
retain some reliability and tests are to remain ^ reasonable length. 
Where chapters in Addison-Wesley provide instruction on more outcomes 
than this, it may be necessary to defer assessment of sofiie otUicomes 
until they are represented in a subsequent chapter. 

3. Examination of -all Descriptors for a Particular Content Strand 

oyer alb Levels of the Program . If there are very fqw descriptors ^ 

that differ* distinctly, or if the set, of descr^iptor:^ show little 

hierarchical relationship, the strand probably does not possess 

strong .sequential characteristics of its own. Frequently, as in 

" Problem, So Iv ing" , the strand exists primarily ^r the inclusion of 

# 

aq^tivi ties where mathematical skills are applied to verbal or pictorial 

problems. Some strands, such as "Set Concepts" in Levels K-3, exist 
s 

principally as a model for wholei numbers ^d related operations. 
By comparisQA, material devoted directly to* the development of con- 
cepts related j:o sets and set theory is relatively minor. 

1 



, OprCOME ASSESSMEUT 

Instructional entries frequently occur in the analysis with no 
accompanying evaluation entries. In general^ this circumstance lm« 
plies one of the following: 

1. Evaluation is deficient 

1. 'Instruction is primarily in the form of teacher explanation 
with little or no independent practice for the pupil, 

3, Instruction and practice on a particular outcome cannot be 
separated .from a more inclusive outcome, 

4, The outcome is minor in conqparison to the amount of instruc- 

•{ 

tioA given on other skills presented in the unit. 

The number of items per skill-per unit averages ^-4 for major 

skills and 1-3 for minor skills. Item frequencies such as these may 

be adequate in skill maintenance or retention, but should probably be 

increased in criterion exercises' where acquisition of new or extended 

skills is assessed. 
« 

INDEPENDENT PRACTICE 

Ihe amount of independent practice on each outcome can be de- 
termined by attending to the numbers in parentheses following under- 
lined and -non-underlined page entries. Of primary interest are 
instances where instructional entries (regular instruction and review) 
are associated with fewer than ten items of independent practice. 
The number ten was chosen as a reference point for the analysis since 
many activities approached but did not exceed this number. It was 
reasoned that outcomes with fewer than ten items of practice, and ^ 
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particularly outcomes with fewer than five or six items, do not pro- 
vide sufficient practice for attainment of the skill. ' 

. PRELIMINARY SPECIFICATIONS OF A LEARNING MASTERY SYSTEM APPLICATION 

CONTENT STRANDS - . " 

The strands of content related to the arithmetic of whole ^d 
rational numbers are dominant. This may be inferred by inspecting the 
number of o^tcomes developed (as represented by outcome descriptor^) 
and the number of instructional entries per outcome. Outcomes develop- 
ed in these strands, as well as most of their substrands, usually in- 
clude at least 10 items of independent practice. Strands such as 
^'Operations'* ^nd, at earlier levels, "Number Theory", could contain 
so many outcome descriptors in common with other strands that it is 
doubtful their preservation as independent outcome areas in a • 
Learning. Mastery System would be worthwhile. In general, the number 
of content domains (twenty-one) will be reduced by combining doipains 
in^ an application of the Learning Mastery System. 

INSTRUCTIONAL OUTCOMES 

Five or six broad outcomes such as the following likely will be ^ 
recommended" as a basic outcome structure for the development of 
LearniAg' Mastery^ System procedures : 

1. Recognize basic elements and concepts 

2. Decode systems of S3rrabols - — - 
. 3. -^Express mathemati^cal relationships 

4. Verify mathematixajl relationships 
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5 m Per.form operations 
6. Solve verbal problems 

One or more^of these outcomes represent major skills to be develop- 
ed in- each of content domains such as the following: 
I. Sets 

II. Whole numbers ' • 

III. Rational numbers (positive) 

IV. Integers . 
V. Geometry , - 

VI. Measurement 
VII. Logic 

Pupil progreiss througih broad instructional sequences for outcomes 

« 

applicable to each content domain will be monitored throughout the 
'^rogram^ ,At each level, a set of outcome descriptors will further ^ 
refine cells in the outcome-content matrix to reflect all of the 
content included in the program for that level. 

EVALUATION COMPONENTS 

In a number of instances recognition of properties of mathemati- 
cal operations is introduced throtigh verbal instructions given by the 
.teacher. Pupils are encouraged but not required to recognize these 
properties in solving related eqiiations or problems. .Acquisition of 
skills such as these should not be assessed in a Learning Mastery 
System until approximately 10 items of independent practice have been 
provided in a single chapter. 



ERIC 



.12 



Occasionally cliaptets contain instructional .entries classifieJ iindei; 
outcome descriptors wbich are .peripheral to major skills under 
development;' The major focus in chapters such as these will be 
assessment of outcomes introduced and any of their prerequisites which 
are reviewed. In chapters where no instruction on new outcomes is 
begun, the principal outcomes under review will be evaluatS&^« The con- 
text for evaluation should include settings which parallel those used 
during regular instruction, but they should also include some transfer 
settings whicli may be generally familiar to the pupil but not in 
association with the outcome under development. In general, there should 
not be more than two or three items of the latter type ,for any particu- 
lar outcome developed in a chapter. 

IMS evaluation components for Add i son-Wesley should include 
the following: • ^ - 

Four to Six Pretests for Each Level . 3lie number of. pretests 
will be determiiied by the ntimber of major breaks in the continuity of 
the instructional sequence. It will not be necessary to specify a 
pretest fot each chapter, since many follow directly from, the previous 
chapjter. ^sentially, all of thd information which mi^t be of value 
to the teachet can be obtained from posttest or criterion exercise 
instruments for the previous unit. Pretests sTiould provide a compre- 
hensive sample of behaviors that are prerequisirte to the major 
skills developed in the. chapter. The information obtained from the 
pretest should guide the teacher in determining the relative 
emphasis to be given any prerequisite behaviors which are reviewed 
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prior to the introduction of new material. Efforts Ji^ill be made to use 
existing Addisj3n-Wesley Diagnostic Tests, although sections of these 
pretests are not clearly structured according to outcomes^ 

2. En«*route Assessment Devices for Each Major Outcome Introduced 
or Reviewed . , A limited number of problems in the regular daily 

assignment will be identified which, the teacher, can review as a check 

< 

on the progress of the pupil toward mastery of the outcome. 

3. End»of->Unit Criterion Exercise for Each Unit . \,Each exercise 
should include at least one section for each of the major outcomes 

on which instruction was provided in that unit. Approximately 
4-5 items should be included for each individual outcome representing 
material which has been introduced or extended. One or two items ^ 
should be included for 'eath descriptor where previously mastered 
skills have been reviewed or maintained. ""^^^ - 

Each exercise should include a limited number of' problems where 
computational skills which have been developed are appli/|d to the 
solution of verbal problems. The format for all items on the 
criterion exercise should be multiple choice with at least some of the 
distractors representing typical errors which might be made on this 
t3rpe of problem. . '"^ , 

SWRL-deve loped instruments are recommended oVer existing 
Addisbn-Wesley Chapter Tests for the following reasons: 

(1) Add i son-Wesley Chapter Tests are not clearly organized 
around instructional outcomes. 
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(2) Many outcome areas are evaluated with fewer than 4 items 
per instrument. 

(3) The constructed response fonnat used with items is incom- 
patible with machine scoring and remedial practice based on typical 
errors. - 

(4) In Levels 3 and 4, no components foi: formal evaluation of 
Geometry units are presently a>)ailable. 

^PRACTICE COMPONENTS \ 

^Appropriate practice materiarys should be developed as part of 
the LMS. Wherever possible, suppl^entary practice should be pro- 
vided in sdch a way that the *teacherVcan select exercises on the 
basis of major types of errors committed. 



SUPPORT COMPONENTS / \ y 

\ 

Various support components, includiW a technical manual and 
appropriate record keeping materials will\ also be provided. 
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APPENDIX A 

» 

DESCRIPTION dp ADDISON-WESLEY COMPONENTS 

(1) ' Diagoostic tests^ A battery olVl diagaostic tests, with 15- 
20 ^- terns per test, is provided for use prior to instruction in each 
chapter • Hie tests are designed to identify students in need of 
special help on material to be presented in the chapter. Items on all 
of the tests are parallel tp problems provided for practice during 
regular instruction. They sample from a^l material, both introduced 
and reviewed. Test items and sections are not referenced to particu- , 
lar pages in the student text ^r^eacher*s edition. No references are^ 
given in the teacher's edition for use of the tests. 

(2) Duplicating Master^ -A set of duplicating masters is pro- 
vided for each of Levels'^ 1-6. Approximately 90 masters arp* available 
for Levels 1 and 2, and 60 masters for each of Levels 3-6. Biese 
masters contain problems which are parallel to problems included in 
the student's text. Points where duplicating master^ are to be given 
are designated on each master. No references are given in the 
teacher's edition for use of the masters during regular instruction.. 

(3) Workbook- A workbook for each of Levels 3-6 provides approxi- 
mately 95 pages of practice problems parallel to material in the 
student's text. Each practice page is associated with a specific 
page in the student'^ text as designated in a correlation chart 
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located in the workbook. No reference to use of workbooks is given 
in tie teacher's edition. ^ ' , , 

(4) "Getty Ready Books- Readiness books are provided for each 
of Levels 3-6. Bach book includes 48 pages with activities which re- 
view material presented' in the previous grade level. 

(5) Chaptgr^ and Term Tests- 'A battery of tests is provided for 
use after instruction in each chapter. One test of approximately 20 
items is available for each chapter. Two additional tests are to ba used 
at midyear and after cdmpletion of the textbook. Items on, all of the * 
tests are parallel to problems, provided for practice during regular 
instruction. Test items and sections are not referenced to par- 
ticular pages in the student's text. No references are given in the 
teacher '^s edition to use of this battery. 
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APPENDIX B 



CONTENT ANALYSIS 
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